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1.  Introduction 

Recently  the  SIAM  Journal  has  published  two  papers  [l»  8]  which  present 
elaborate  classifications  and  sophisticated  constructions  for  two  classes  of 
problems  in  probabilistic  programming.  Neither  the  authors  of  these  papers, 
nor  their  referees,  appear  to  have  recognized  that  the  problem  in  [l]  and  the 
problems  in  [8]  (for  example,  the  '‘complete"  problem)  are  very  special  in¬ 
stances  of  the  class  of  "constrained  generalized  median"  problems  first  discus? 
by  Charne8,  Cooper  and  Thompson  in  1961.—^  This  canonical  "median"  formul.: 
tion  is  not  a  matter  of  a  choice  of  nomenclature.  Its  technical  advantage  in  mai 
problems  in  probabilistic  programming  derives  from  bringing  into  immediate 
focus  the  relevance  of  the  absolute  value  function. 

As  we  shall  demonstrate  below  by  means  of  the  absolute  value  function  we 
easily  (1)  obtain,  characterize  and  markedly  extend  the  essential  results  of  fi], 
(2)  interpret  these  results  in  linear  programming  and  probabilistic  terms,  (3) 
develop  gradients  and  directional  derivatives  and  interpret  probabilistically 
incremental  formulae  in  all  generality,  (4)  place  these  results  in  the  framework 
of  chance- constrained  programming,  and  (5)  reduce  all  cases  to  investigation  of 
the  behavior  of  the  objective  function  along  a  ray. 

Before  undertaking  these  developments  and  in  order  not  to  interrupt  them., 
some  important  assertions  and  constructions  in  [l]  require  correction.  The 
problem  in  [l]  is  to  choose  a  vector  X  S  0  which  maximizes  the  expected 

m  m 

T 

value  of  the  function  p  X  +  S  gj  (X,b), 

i=l 


— /  See  reference  [4] 
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if  b  -  aS(  <  0 
if  bt  -  a^X  >  0, 

and  yi  >  6^ 

^  t 

Here  a  ,i*l,..m,  is  the  l  row  of  a  given  mxn  matrix  A, 

Y^  and  fi^,i«l...m,  are  given  constants, 

T 

p  is  a  given  lxn  vector, 

and  b^,i«l, . . .  ,m,  are  random  variables  whose  marginal  distributions 
are  known. 

Thus  the  problem  is 

T  m 

max  E(p  X  +  £  g  (X,b)) 

i«l 

(2)  subject  to  X  >  0, 

where  we  compute  the  expectation  using  the  joint  distribution  of  the  random  vari¬ 
ables  b« , .  • .  ,b  « 

In  (2),  it  is  assumed  that  the  vector  X  is  to  be  selected  before  any  ob¬ 
servations  are  made  on  the  random  variables  b^ ,i«l, . . .  ,m.  Thus  X  is  not  per¬ 
mitted  to  be  a  function  of  these  random  variables,  but  rather  it  must  be  a  determin¬ 
istic  vector.  Such  a  vector  of  decision  rules  is  called  a  zero  order  decision  rule 
in  the  customary  terminology  of  chance-constrained  programming.—^  Thus,  (2)  is  a 
chance-constrained  programming  problem  in  which  the  chance  constraints  are  of  the 
particularly  simple  form  P  (X  >  0)  >  1,  in  which  the  function  whose  expectation 
we  wish  to  maximize  is  a  piecewise  linear  function  of  the  vector  of  decision  rules, 
and  in  which  we  seek  the  optimal  zero  order  rule. 


where 

(1) 


g^X.b) 


(bi  -  a  X) 

(bt  -  fliX)  6t 


— ^For  results  on  zero  order  rules  see  references  [2,  3,  4,  5,  6], 
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In  the  mathematical  development  presented  in  section  2,  we  first  show  that 
(2)  can  be  converted  into  a  constrained  generalized  median  problem  of  the  type 
discussed  in  [4],  This  transformation  enables  us  to  use  standard  linear  program¬ 
ming  methods  in  obtaining  our  results.  It  also  permits  us  to  indicate  how  these 
results  can  be  extended  in  two  important  directions:  one  is  the  case  in  which 
g^(X,b)  is  a  piecewise  linear  function  of  b^,  ...  ,b^  rather  than  only  b^ 
as  it  is  in  (1);  the  other  is  the  case  in  which  X  is  subjected  to  other  linear 
constraints,  say  DX  >  d,  in  addition  to  the  constraints  X  >  0.  Neither  of 
these  extensions  are  discussed  in  [1],  and  the  techniques  used  in  [lj  cannot  be 
readily  extended  to  include  these  cases. 

The  main  results  in  [1]  are  a  pair  of  theorems  which  give  necessary  and 
sufficient  conditions  for  the  existence  of  an  optimal  solution  to  (2).  We  will 
obtain  most  of  these  conditions  in  a  much  more  direct  manner  than  was  used  in 
[1],  In  particular,  our  proofs  will  require  only  well-known  theorems  in  linear 
programming  and  some  elementary  inequalities  on  the  absolute  value,  and  will  not 
require  concepts  such  as  Kakutani's  fixed  point  theorem  which  were  used  in  [1], 
Neither  will  we  require  the  elaborate  specifications  of  classes  of  probability  dis¬ 
tributions  used  in  [1]. 

One  result  obtained  in  [1]  characterizes  the  situation  in  which  the  objective 
function  of  (2)  is  bounded  from  above,  but  the  supremum  of  the  function  is  not 
attained  for  a  finite  X.  Rather  than  deriving  this  particular  result,  we  character¬ 
ize  this  situation  in  a  constructive  way  by  showing  that  it  can  be  related  to 
the  behavior  of  the  objective  function  along  a  particular  ray  and  by  obtaining  an 
explicit  expression  for  its  limiting  value. 
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First,  however,  we  must  correct  some  assertions  in  [1]  about  the  admissible 
class  of  random  variables.  In  [1]  it  is  assumed  that  F^,  the  cumulative  dis¬ 
tribution  function  of  b^,  has  at  most  a  finite  number  of  discontinuities  in 
each  finite  interval.  In  our  development  in  section  2  it  will  be  clear  that  such 
an  assumption  is  never  required.  We  can,  for  example,  admit  random  variables 
whose  distribution  function  has  probability  mass  at  all  the  irrational  points  in 
an  interval  (or  on  the  real  line). 

It  is  also  assumed  in  [1]  that  F^(*)»i.“l»..  ,m,  satisfies  the  following  con¬ 
ditions  : 


3(a)  lim  -  0. 

z^-»-ao 

and 

3(b)  *  °- 

A  remark  is  then  made  [1,  p.  930]  to  the  effect  that  3(a)  and  3(b)  are  "sufficient 
for  (but  slightly  stronger  than)  the  existence  of  the  first  moment  of  F^(*)*" 

In  actual  fact,  as  we  prove  in  theorem  2, 3(a)  and  3(b)  are  necessary  for  the  exist- 

but  they  are  not  sufficient.  This  can  be 

z  >  -  c 

z  <  -  e 


ance  of  the  first  moment  of  Fi(*)» 
seen  by  the  following  example: 

Let  F(z)  ^  (  1 


z  |  In  z 


Then 


and 


lim  zF(z)  = 
z  --»■ »® 


li^  z[l-F(z)] 


0, 


lim  T~"rn" 
-►-««  In  I  z  | 

as  F(z)  = 


=  0 

1  for 


z  >  -  e 


Hence  F(z)  satisfies  conditions  3(a)  and  3(b).  However,  F(z)  does  not  have  a 
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first  moment  since 


J***  zdF(z) 


e 


e 


e 


ar> 


/ 


zj . .A  dz 

(vz2[ln(-z)]2  ) 


l+ln(z) 

2  dz 

z[ln(z)] 


- -  dz  +  e 

z[ln(z)] 


ln(ln(e)> 


-  -  since  the  integral  term  is  negative  and  lim|tn[ln(ln(t ) )]  *=  «.  Thus  E(z) 
does  not  exist . 

Conditions  3(a)  and  3(b)  are  used  repeatedly  in  [l]  to  guarantee  that  the  in¬ 
tegration  by  parts  formula 

X  X 

f  Ft(z)  dz  -  xFt(x)  -  „lim  m  zF^z)  -  J  zdF^z) 


is  valid.  But  the  above  example  shows  that  conditions  3(a)  and  3(b)  are  not  suf¬ 
ficient  to  guarantee  the  validity  of  this  integration  formula  since  both  integrals 
diverge.  On  the  other  hand,  the  existance  of  E(z)  is  certainly  a  sufficient 
condition  for  the  formula  to  be  meaningful. 


2.  Mathematical  Development 

We  begin  by  introducing  some  notation.  Let  Y  be  an  n-vector. 
Then  |YT|  -  (|yj  ,  ...,  |yj  ,  ...,  |yj) 

and 

b|*T|  -  <E|yi|  .  ....  E|yt|,  ....  E|yn|>. 

We  will  use  |  ( Y  1 1  to  denote  the  norm  of  Y. 


6 


From  the  definition  of  g^(X,b)  in  (1)  we  have  that 
,  6i  fw  i.,1  .  -t...  A  .  vi  A,  J 


gt(X,  b)  «  ^  (lbi  ‘  flixl  +  <bi  -  alX)}+  Y  ((bi  “  flix)  '  lbi  '  flixl)  ‘ 
lence 

b>)  =(~ P1)  E<V  -  (^4 — )  al*  +  (^~rz)  Elbi  -  al*l 

md 

E^pTX  +  ^  g^X,  b)^  =  pTX  +  ^  E^gi(X,  bfj  =  ^  ^  6.1  ■■  ■  yk)  E(b±) 


< f  -  i^)')  -  id**- 


■)  El11!  *  ***1  • 


m  /  6i  +  Vi  \ 

Thus,  dropping  the  constant  term  J  f  - - - -J  E(b^)  from  the  objective  function, 

(2)  can  be  written  as 

//N  min  h(X)  «  cTX  +  aTE|b  -  AX  I 


where 


subject  to  X  ^  0 

m  /'6l  +  Yl 


aij  “  Pj »  J  “  •  •• »  n  , 


Yf  "  ®i 

OC^  =  ^  ♦  i  m  1 1  j  nil 


Also  >  0  as  we  are  given  that  y^  >  8^. 

(4)  is  a  constrained  generalized  median  problem  of  the  type  discussed  in  [4], 
The  constraints  are  of  the  particularly  simple  form  X  >  0. 

Theorem  1:  We  first  note  that  h(X)  is  finite  for  some  X  >  0,  in  which  case 
h(X)  is  finite  for  all  X  >  0,  if  and  only  if  E | |  <  oo  for 
all  i  such  that  >  0  (i,e.  y^  >  6^). 

Proof :  Using  the  well-known  and  elementary  inequalities  on  the  absolute  value 

we  have  that 

| AX |  -  | b |  <  | AX |  -  |b|  I  <  |b  -  AX|  <  |b|  +  | AX | 
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Theorem  2 


Proof: 


and  so  applying  the  expected  value  operator  (which  is  order-  pre¬ 
serving)  to  both  sides  of  the  inequalities  we  get 

(cTx+aT|Ax|)  -  0TE|b|  <  h(x)  <  (cTx  +  aT | ax | )  +  afi:| b|  . 

This  establishes  the  sufficiency  of  the  stated  conditions;  neces¬ 
sity  is  clear. 


:  A  necessary  condition  for  E|b  j  <  oo  is  that 
lim  tP  1  jb  |  >  t^  ■  0. 


t->GD 

Let 


Xt 


f1.  IbJ  <t 


(o,  |bt|  >  t 

Then  E|bJ  .  EflbJ^l  +  E^bjd  -  ^  . 

But  by  definition  of  the  Lebesgue -St ielt jos  (or  Radon)  integral, 
E  |  b^  (  =  lim  E(|biJxt)  when  E  |  b^  |  <  oo  . 


t->oo 


0  as  t  — >  qd  . 


Thus  E  (jbjd  -  xt))  - 
But  E  ^|bj  (1  -  xt)  )  -  J  |b1l<IF1(bi)  >  tP  £  |bt|  >  tj  >  0  for 


t  >  0. 


So  when  E J  b^  |  <  oo  we  have  tP  ^ 
To  see  that  the  condition 


M  >-  ‘j 


~>0  as  t-^-oo 


lim  tP  (  Jb  |  >  tl  »  0 
t~*'+00  ^  ' 

is  equivalent  to  3(a)  and  3(b),  note  that 

P  £ IbJ  >  tj  -  P(bt  >  t)  +  P(b±  <  -t)  =  1  -  Ft(t)  +  Fi(-  t). 

Hence  we  have  0  ■  lim  f  t[l  -  F  (t)]  +  tF  (-  t)J  , 

and  since  F^(  )  is  a  nonnegative  function,  3(a)  and  3(b)  immediate¬ 
ly  result . 
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Theorem  3 


Proof: 


h(X)  is  bounded  from  below  for  all  X  >  0  if  and  only  if  there 
exists  a  w  satisfying 

)  w  |  <  a 

T  T 
w  A  +  c  >0. 


By  virtue  of  the  inequality 

cTX  +  <xt|ax|  -  aTE|b|  <  h(X)  <  cTX  +  <xT|ax|  +  aTE|b| 

obtained  in  the  proof  of  theorem  1,  it  is  enough  to  show  that 
X  T 

c  X  +  a  | AX |  is  bounded  from  below  for  all  X  >  0  if  and  only  if 

X  X 

there  exists  a  w  satisfying  |w|  <  a  and  w  A  +  c  >0. 


(5) 


To  do  this,  we  first  note  that  the  linear  programming  problem 

min  cTX  +  | Ax| 

subject  to  X  >  0 

can  be  rewritten  in  the  following  form: 

min  cTX  +  aT(Y+  +  Y') 


subject  to  Y  -  Y 


AX 


X,  Y  ,  Y  >  0  . 


The  dual  to  this  problem  is 

1 

max  w 
subject  to 


TA  T 
w  A  <  c 

T  T 
w  <  a 

T  T 
w  <  a 


or 


max  w 


T  T 

subject  to  w  A  +  c  >0 


|w|  <  a  . 
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Since  (5)  is  consistent  (the  origin  is  feasible),  the  extended  dual 
theorem  of  linear  programming  (see  [7],  vol.  I,  p.  190)  states  that 
the  objective  function  of  (5)  is  finite  if  and  only  if  there  is  a 
feasible  solution  to  its  dual,  i.e.  (6).  Thus  the  theorem  is  proved. 

To  convert  the  result  of  theorem  3  to  the  corresponding  result  in  [1],  we  use 
T  Vi  "  ®i 

our  definitions  of  c  and  a.  Since  a.  ■  - r -  ,  we  see  that  [w  [  <a 

•i-Yi  Yt-et  + 

means  - ^ -  <  w4  <  - 5 -  .  If  we  put  tt^  ■  w^  +  (  - - -  J  ,  then  the 


condition  jwj  <a  becomes  6^  <  tt^  <  •  Similarly,  since 

ra  /  ®i  +  Vi'N  T  T  T  T  T  T 

c  o  £  I - 5 -  ]  a  -  p  ,  we  get  that  wA  +  c  ■  tt  A  -  p  ,  so  w  A  +  c  >0 

J  i-A  1  J  1J  J 

T  T 

becomes  tt  A  >  p  .  Thus  we  see  that  theorem  3  is  analogous  to  the  result  in  [l] 
which  says  that  the  optimal  value  of  the  objective  function  to  (2)  is  finite  if  and 


only  if  there  exists  an  m-vector  tt  satisfying 

TA  T 
TT  A  >  p 

and  6  <  n  £  V  • 

We  not  turn  to  an  elucidation  of  what  is  termed  in  [1]  the  "insoluble—1 ^ 

finite"  case.  This  is  the  situation  we  mentioned  in  the  introduction  in  which 

h(X)  is  bounded  from  below  but  its  infimum  is  not  attained  for  a  finite  X,  i.e. 

h(X)  >  inf  h(X)  for  all  X  >  0. 

X>0 


l:  As  t->oo  ,  E  j  b  ^  -  tqj  ~  /  tq  -  E^),  q  >  0 

<  E(b  )  -  tq,  q  <  0 


E|bt| 


>  q  ■  0, 


where  we  use  the  symbol  to  mean  that  the  difference  between  the 
two  quantities  tends  to  zero  as  t — >-cd  . 


-^This  terminology  is  peculiar  since  we  explicitly  express  the  optimal  value 
of  the  objective  function  for  this  case.  This  is  done  in  the  corollary  to  theorem  4. 
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Proof: 


Now 

and  b2  - 

Corollary 

Proof: 


Theorem  5 

Proof: 


Define  the  function  v  «  v  (b . ) 

*tq  "tq  1 


1.  \  <  tq 
0,  b  >  tq 


Then  E|b±  -  tq|  =  E[(br  tq)(l  -  xtq)]+EC<tq  -  b^x^J 

■>  /e^)  -  MCbjX^))  +  tq[P(bt  <  tq)  -  P(bt  2  tq)]. 


But  E(bjXtq)W  °»  q  <  0  as  t — >-a>  , 

(eO^),  q  >  0 

and  the  second  term  on  the  right  approaches  tq  if  q  >  0  and 
-  tq  if  q  <  0.  Thus  the  theorem  is  proved, 
fix  X  and  define  1^  =  ^i  :  a*X  =  oj  .  Let  bj  «  -  b^  sgn  (a*X) 
b^  ,  i  €  1^  .  Then  we  have 
0  ,i/l° 

:  As  t-*co  ,  h(tX)  ~  t[cTX  +  ftT|AX|  ]  +  a.T  [E  (b 1 )  +  E  |  b2 1  ]. 

h(tX)  «  tcTX  +  aTE|b  -  tAX|^  tcTX  +  E  na.E|b  | 

i6l 

+  E  0  a.  sgn  (aScjfta^X  -  E(b  )] 
i/£l 

-  t[cTX  +  (XT|ax|  ]  +  ^[ECb1)  +  E|  b2 1  ]  . 


:  Suppose  that  h(Xn) — ^vq  for  some  sequence  ^n^) 


with 


X  >0,  I  lx  I  | — >>oo  as  n — hao  ,  where  v_  -  inf  h(X). 
n  -  ’  1  1  n1  1  0  x>0 

Then  cTY  +  aT|AY|  *  0  for  some  Y  >  0  with  ||y||  =  1. 


Since  the  set  S^  ;  ^X:  ||x||  «  1,  X  >  0^  is  compact,  the  set 


r  x 


n 


nor 


has  a  limit  point  Y  in  S. .  Moreover,  there  exists  some 


V  '  n 


subsequence,  which  we  denote  by 


N 


such  that  Y 


n 


Y  as 


n — oo  . 
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Now 

(7)  |j%-"||  (cTXn  +  aX|AXn|)  «  cTYn  +  aT|AYnl-»cTY  +  aT  |  AY  [  as  n-^oo. 

T  T 

However,  cX  +  a  I  AX  I  is  bounded  from  below  since  h(X  )  >  vn. 

This  follows  from  the  inequality  (c^X  +  a^|AX|)  -  a,TE|b|  <  h(X) 

<  (cTX  +  aT|AX|)  +  aT E | b | .  Thus,  in  particular,  cTXn  +  aT|AXn|  remains 
bounded  while  l!^nl! — ><»  .  Hence,  from  (7),  we  conclude  that  the  left 

m  m 

hand  side  goes  to  zero  while  c  Y  +  a  | AY |  >0.  Thus  the  theorem  is 
proved . 

We  will  now  show  that  when  exists  wi>:h  the  properties  described  above, 

h(X)  must  approach  its  infimum  along  some  ray  in  the  orthant  X  >  0.  First,  how¬ 
ever,  we  establish 

T  T* 

Lemma  1:  For  any  vector  5,  |h(X  +  5)  "  h(X)|  <  |cs|  +  a,  |  A^| . 

Proof:  | h(X  +  ?)  -  h(X)|  =  |cT?  +  ctTE(|b  -  AX  -  A£  -  | b  -  Ax|  ) 

<  cT5  +  olTe|a?|  <  |cT5|  +  txT | A5I . 

Theorem  6:  Let  llYnll  =  1 »  an<^ 

let  t — >■  00  as  n  — ►  00  . 
n 

Assume  h(t  Y  )-*-vn  as  n— >  00  and  Y  =  lim  Y 
n  n  0  n 

n~yoo  . 


Then  hCt^Y)  >Vq  as  n-»oo  . 

There  are  only  a  finite  number  of  ways  an  11-tuple  can  be 


partitioned  into  subsets  of  components  such  that  the  components  in 
a  subset  are  either  all  positive,  all  zero,  or  all  negative.  Thus 
there  exists  some  subsequence  of  ^Y^  »  which  with  a  minor  abuse 
of  notation  we  also  denote  by  \^n\)  •  with  the  property  that  the 
components  of  AY^  are  of  constant  sign  for  all  n. 
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“  0  *  “V*1*  ■  0 

I  0  otherwise , 

where  y.  is  the  ith  element  of  Y  . 

'in  n 

Then  the  sign  of  each  component  of  A(Y  +  fl^)  remains  the  same 
for  all  n  sufficiently  large.  Also 

h(t  Y  +  t  4  )  ~  h(t  Y  )  by  theorem  5 
n  n  n  n  n 

and  h(tnYn>— *Vq  hypothesis. 

But,  by  Lemma  1,  |h(tnY  +  t^)  -  h(tnY)|  <  tn[|cT6j  +  aT|A6n|] 
and  by  our  definition  of  the  expression  on  the  right  ap¬ 

proaches  zero  as  t — ►ao  .  Thus  h(t  Y)— ►v.  as  n— *-oo  . 

n  n  u 

Thus  we  have  reduced  the  problem  to  one  of  investigating  the  behavior  of  h(X) 
along  rays  in  the  nonnegative  orthant.  Moreover,  by  the  corollary  to  theorem  4, 
the  "knife-edge"  cases  in  which  cTX  +  0^|ax|  ■  0  have  c^fECb^)  +  E|b^|]  as  the 
optimal  value  of  the  objective  function.  However,  it  should  be  expressly  noted 
that  these  "knife-edge"  infinite  ray  cases  can  never  appear  as  solutions  to 
practical  problems.  Rather  they  exhibit  .»n  inadequacy  of  realistic  formulation 
of  the  model.  We  develop  their  properties  here  only  for  completeness  of  analysis. 

we  now  turn  to  the  developswnt  of  increisental  formulae  and  their  interpretation 
in  probabilistic  terms.  It  should  be  noted  that,  again,  elementary  properties  of 
absolute  values  quickly  and  naturally  lead  to  results  in  all  generality. 
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3 .  The  Increment  and  the  Radial  Directional  Derivative  of  h(X). 

We  now  give  expressions  in  terms  of  the  probabilities  of  the  various  b 

versus  AX  events  for  the  increment  of  h(X)  (i.e.,  h(X  +  5)  "  MX)  )  find 

for  the  directional  derivative  h(tX)  whenever  the  latter  exists.  The  ex- 

dt 

pressions  are  free  of  any  restrictions  as  to  the  character  of  the  distributions 
of  the  b. 

First,  on  inspecting  figure  1  below,  we  note  that,  for  e  >  0, 

(  6  ,  u  <  a 

f  (u  )■  |  u  -  (a  +  e  )  |  -  |  u  -  a  |  =  je  +  2(a  ■  u),  a  <u  <a  +  6 

C  -€  ,  u  >  a  +  e  . 


Figure  1 

Thus,  if  u  is  a  random  variable  with  finite  expectation. 


|e+2a-2  ^a+eS(6)^ 

for  some  0  <  0(6)  <  1  by  the  mean  value  theorem.  In  other  words, 


iu^|u-(a+6)|  -  |u-a|^»€[P(  u  <  a+6)  -  P(u  >  a+6)] 


P(a<  u 


(8) 


Eu  Qu-(a+e)|  -  |u-aQ  ■  6-[P(u  <  a+6)  -  P(u  >  a+e)  -  20(6)P(a  <  u  <  a+e)], 


<  a+6) 
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But 


h(X+5)  -  h(X) 


T, 

c  ? 


AX  -  A?| 


9 


so  if  we  use  (8)  we  get,  using  P(b  >  AX)  to  denote  the  vector  whose  components  are 


p(bi  >  flix) * 

(9)  h(X+$)  -  h'X) 


cT5  +  aTD(A5) 

-  2D  (9  (|A?| 


j^P  ^  b  <  A(X  +  5)  -  P(b  >  A(X+ £) ) 

)  P(AX  <  b  <  A(X+5)^ 


where  D(y)  denotes  the  diagonal  matrix  whose  diagonal  consists  of  the  components 
of  the  vector  y  and  where  0  ( J  A5  J )  ■  ^0  ^  ( |  a  ^  5 1 ) ,  ®m(|ain?|)^  with 

osvM  )  <  1.  Thus  we  have  an  expression  for  the  increment  of  h(X),  and 
thereby  an  expression  for  any  possible  directional  variation,  in  terms  of  the 
probabilities  of  various  events.  Clearly  then,  any  conditions  on  the  probability 
distributions  involved  in  b  which  guarantee  that  P(AX  <  b  <  A(X+£)) — VO  as 
llsll-'*-®  will  guarantee  the  existence  of  a  gradient  of  h(X)  at  X. 

We  now  specialize  (9)  as  follows:  In  (9)  replace  X  by  tX  and  5  by  €X. 
Then  we  get 


h(t+6)X  -  h(tX)  -  cT  (€X)  +  aTD(A6X) 


[p(b  <  A(t+e)X^  -  P  (b  >  A(t+0)x) 


-2D  (e(|A6X|)^  P  ^AtX  <  b  <  A(t+e)xjJ  -  g£cTX  +  aTD(AX)  jp^b  <  (t+6)AX^ 
-P^b  >  (t+6)AX^  -  2D^0(|AX|  )^P^tAX  <  b  <  (t+6)AX^~j^ 


Then  as  t-»oo  we  get,  for  any  fixed  6  >  0, 


(10)  h  -  hSsn  „  cxx  +  aT!AX|  . 

Thus,  if  the  left  hand  side  of  (10)  has  a  limit  as  e— >-0,  we  see  that  the  directional 
derivative  —  h(tX)  is  given  by 


(11)  h(tX)  -  cTX  +  aT|Ax|  . 

It  is  clear  that  computational  methods  can  be  based  on  our  expressions  (9),  (10) 
and  (11),  but  we  shall  reserve  these  developments  for  another  occasion. 
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4.  Extensions 

The  special  model  treated  in  [1]  is  rarely  of  any  real-world  or  economic  - 
theoretical  significance  because  many  constraints  cannot  be  expressed  adequately 
by  '•linear"  penalty  functions.  As  a  simple  reminder,  note  that  X  must  be 
bounded,  although  of  course  the  specification  of  the  bounds  may  involve  inter¬ 
relations  between  groups  of  the  individual  variables.  We  have  chr^en  to  develop 
our  results  for  clarity  and  ease  of  comparison  in  the  context  of  [1],  However, 
it  should  be  obvious  on  reflection  that  practically  all  the  developments  of  the 
preceding  sections  can  be  extended  to  the  case  where  there  are  additional  linear 
inequality  constraints  on  X  in  (2). 

For  example,  consider  the  extension  of  theorem  3  to  the  case  where  X  must 
also  satisfy  DX  >  d.  Then  our  proof  of  theorem  3  requires  only  the  obvious 
modification  of  the  dual  problem.  Thus  we  get 


Theorem  7:  If  the  constraints  DX  >  d,  X  >  0  are  consistent,  the  optimal  value 
of  the  objective  function  for  the  problem 


min  cTX  +  aTE|b  -  AX| 
subject  to  DX  >  d 
X  >  0 


is  finite  if  and  only  if  there  exist  vectors  w  and  v  satisfying 


T  T 
-w  A  +  v  D  <  c 


T 


|w|  <  a 

v  >  0  . 

A  much  more  significant  extension  of  the  general  model  follows  from  observing 
that  the  linear  constraints  DX  >  d  can  be  considered  to  be  the  deterministic 
equivalent  constraints  for  chance  constraints  P(DX  <  b)  >  g.  This  follows  from 
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the  fact  that  since  X  is  a  zero  order  rule,  the  chance  constraints  can  be  re¬ 
placed  by  the  equivalent  set  of  deterministic  constraints  DX  <  f”*(1-0),  where 
F  1  (1-3)  is  the  vector  of  F^(l-0^),  the  (1-0^)  fractile  point  of  the  marginal 
distribution  of  b^. 

It  is  also  evident  that  modifying  the  objective  function  to  the  form 

min  cTX  +  E|Gb  -  AX|  , 


where  G  is  a  given  mxm  matrix,  does  not  affect  the  proof  of  our  theorems. 

Thus  our  results  hold  for  the  very  general  class  of  constrained  generalized  median 
models  discussed  in  [4]. 

Finally*  it  should  be  noted  that  the  so-called  "complete"  problem!./  0f 

linear  programming  under  uncertainty  is  merely  another  special  instance  of  the 
constrained  generalized  median  problem,  and  as  such  it  is  susceptible  to  our  analysis. 


To  see  this  we  merely  observe  that  the  complete  problem  can  be  written  as 


min  c  X  +  E  [  Eg.  (x,b) 

V1”1 

s.t.  D  X  =  d 


X  >  0 


where  gi(X,b)  = 


<b  -  aiX)yi  if  -  a1*  <  0 

(bi  -  aiX)6i  if  b£  -  ah  >  0. 


This  formulation  is  obtained  by  expressing  the  second  stage  decision  variables 
in  terms  of  the  first  stage  decision  variables  X. 


-See  [8], page  102. 
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